Power Optimizations in MTJ-based Neural Networks through Stochastic Computing

Artificial Neural Networks (ANNs) have found widespread applications in tasks such as pattern recognition and image classification. However, hardware implementations of ANNs using conventional binary arithmetic units are computationally expensive, energy-intensive and have large area overheads. Stochastic Computing (SC) is an emerging paradigm which replaces these conventional units with simple logic circuits and is particularly suitable for fault-tolerant applications. Spintronic devices, such as Magnetic Tunnel Junctions (MTJs), are capable of replacing CMOS in memory and logic circuits. In this work, we propose an energy-efficient use of MTJs, which exhibit probabilistic switching behavior, as Stochastic Number Generators (SNGs), which forms the basis of our NN implementation in the SC domain. Further, error resilient target applications of NNs allow us to introduce Approximate Computing, a framework wherein accuracy of computations is traded-off for substantial reductions in power consumption. We propose approximating the synaptic weights in our MTJ-based NN implementation, in ways brought about by properties of our MTJ-SNG, to achieve energy-efficiency. We design an algorithm that can perform such approximations within a given error tolerance in a single-layer NN in an optimal way owing to the convexity of the problem formulation. We then use this algorithm and develop a heuristic approach for approximating multi-layer NNs. To give a perspective of the effectiveness of our approach, a 43% reduction in power consumption was obtained with less than 1% accuracy loss on a standard classification problem, with 26% being brought about by the proposed algorithm.Comment: Accepted in the 2017 IEEE/ACM International Conference on Low Power Electronics and Desig

Towards Intelligent Distribution Systems: Solutions for Congestion Forecast and Dynamic State Estimation Based Protection

The electrical distribution systems are undergoing drastic changes such as increasing penetration level of distributed renewable energy sources, energy storage, electrification of energy-efficient loads such as heat pumps and electric vehicles, etc., since the last decade, and more changes are expected in the future. These changes pose challenges for the distribution system operators such as increased level of network congestions, voltage variations, as well as protection settings and coordination, etc. These will require the development of new paradigms to operate distribution systems securely, safely, and economically while hosting a large amount of renewable energy sources.First, the thesis proposed a comprehensive assessment framework to assess the distribution system operator’s future-readiness and support them in determining the current status of their network infrastructures, business models, and policies and thus to identify areas for required developments. The analysis for the future-readiness of the three distribution system operators (from France, The Netherlands, and Sweden) using the proposed assessment framework has shown that presently the distribution system operators have a rather small penetration of renewable energy sources in their grids, however, which is expected to increase in the future. The distribution system operators would need investments in flexibilities, novel forecasting techniques, advanced grid control as well as improved protection schemes. The need for the development of new business models for customers and changes in the policy and regulations are also suggested by the analysis. Second, the thesis developed a congestion forecast tool that would support the distribution system operators to forecast and visualize network overloading and voltage variations issues for multiple forecasting horizons ranging from close-to-real time to day-ahead. The tool is based on a probabilistic power flow that incorporates forecasts of production from solar photovoltaic and electricity demand combined with load models along with the consideration of different operating modes of solar photovoltaic inverters to enhance the accuracy. The congestion forecast tool can be integrated into the existing distribution management systems of distribution system operators via an open cross-platform using Codex Smart Edge technology of Atos Worldgrid. The congestion forecast tool has been used in a case study for two real distribution systems (7-bus feeder and 141-bus system). It was demonstrated in the case study that the tool can predict the congestion in the networks with various prediction horizons. The congestion forecast tool would support distribution system operators by forecasting the network congestion and setting up a congestion management plan.Finally, the dynamic state estimation based protection scheme supported by advanced measurement technologies developed within EU project UNITED-GRID has been implemented and validated experimentally at Chalmers power system laboratory. This dynamic state estimation based protection scheme has a strong advantage over the traditional protection scheme as it does not require any relay settings and coordination which can overcome the protection challenges arising in distribution grids with a large amount of renewable energy sources. The results from the validation of the dynamic state estimation based protection scheme at Chalmers laboratory have shown that the fault detection using this scheme has worked properly as expected for an application of the line protection

The Use Of Non-Invasive Fibrosis Markers In Stratification Care Pathways For The Management Of Chronic Liver Disease

The health, societal and economic consequences of chronic liver disease (CLD) are substantial and increasing exponentially. Cirrhosis is typically detected in the latter stages when prognosis is poor. Timely diagnosis is hindered by reliance on non-discriminatory tests for fibrosis. I explored the role of non-invasive tests (NITs) of liver fibrosis in primary care to promote earlier disease detection. In this thesis, a systematic review revealed a paucity of published studies evaluating NIT in the community setting. A national survey demonstrated that UK specialists consider current fibrosis assessment methods to be sub-optimal, and NIT are important in improving disease stratification in primary care. To benchmark standard care, a one-year retrospective study of GP referrals for non-alcoholic fatty liver disease (NAFLD) established 93% of referrals to have non-significant fibrosis (Brunt ≤ F2) as assessed by liver specialists. Over two-thirds had a low-risk FIB-4 (<1.30) and could have avoided referral, although a quarter of patients with indeterminate FIB-4 (1.30 – 3.25) had significant liver fibrosis suggesting patients in this subgroup warrant further evaluation. As part of the Camden and Islington liver working group, I developed and evaluated a NAFLD pathway that employs FIB-4 and ELF to identify patients with advanced fibrosis or cirrhosis (Brunt ≥ F3 fibrosis). The pathway processed nearly 1500 patients over two years, resulting in a reduction in the proportion of total patients referred and an 81% decrease in referral of patients with non-significant fibrosis. The pathway achieved a 5-fold increase in the referral of patients with advanced fibrosis and 3-fold increase in the detection of liver cirrhosis. To further extrapolate these findings, I developed a probabilistic decision analytical model which tested FIB-4, ELF and fibroscan, either alone or in combination in primary care pathways. Cost consequence analyses revealed all strategies to be clinically effective and cost-saving compared to standard care

Operation, Monitoring, and Protection of Future Power Systems: Advanced Congestion Forecast and Dynamic State Estimation Applications

The electrical power systems are undergoing drastic changes such as increasing levels of renewable energy sources, energy storage, electrification of energy-efficient loads such as heat pumps and electric vehicles, demand-side resources, etc., in the last decade, and more changes will be followed in the near future. The emergence of digitalization and advanced communication in the case of distribution systems to enhance the performance of the electricity infrastructure also adds further complexities. These changes pose challenges such as increased levels of network congestion, voltage variations, protection mis-operations, increased needs for real-time monitoring, and improved planning practices of the system operators. These challenges will require the development of new paradigms to operate the power grids securely, safely, and economically. This thesis attempted to address those challenges and had the following main contributions:First, the thesis started by presenting a comprehensive assessment framework to address the distribution system operators’ future-readiness and help the distribution system operators to determine the current status of their network infrastructures, business models, and policies and thus identify the pathways for the required developments for the smooth transition towards future intelligent distribution grids.Second, the thesis presents an advanced congestion forecast tool that would support the distribution system operators to forecast and visualize network congestion and voltage variations issues for multiple forecasting horizons ranging from close-to-real time to a day-ahead. The tool is based on a probabilistic power flow that incorporates forecasts of solar photovoltaic production and electricity demand, combined with advanced load models and different operating modes of solar photovoltaic inverters. The tool has been integrated to an existing industrial graded distribution management system via an IoT platform Codex Smart Edge of Atos Worldgrid. The results from case studies demonstrated that the tool performs satisfactorily for both small and large networks and can visualise the cumulative probabilities of network congestion and voltage variations for a variety of forecast horizons as desired by the distribution system operator.Third, a dynamic state estimation-based protection scheme for the transmission lines which does not require complicated relay settings and coordination has been demonstrated using an experimental setup at Chalmers power system laboratory. The scheme makes use of the real-time measurements provided by advanced sensors which are developed by Smart State Technology, The Netherlands. The experimental validations of the scheme have been performed under different fault types and conditions, e.g., unbalanced faults, three-phase faults, high impedance faults, hidden failures, inductive load conditions, etc. The results have shown that the scheme performs adequately in both normal and fault conditions and thus the scheme would work for transmission line protection by avoiding relay coordination and settings issues.Finally, the thesis presents a decentralized dynamic state estimation method for estimating the dynamic states of a transmission line in real-time. This method utilizes the sampled measurements from the local end of a transmission line, and thereafter dynamic state estimation is performed by employing an unscented Kalman filter. The advantage of the method is that the remote end state variables of a transmission line can be estimated using only the local end variables and, hence, the need for communication infrastructure is eliminated. Furthermore, an exact nonlinear model of the transmission line is utilized and the dynamic state estimation of one transmission line is independent of the other lines. These features in turn result in reduced complexity, higher accuracy, and easier implementation of the decentralized estimator. The method is envisioned to have potential applications in transmission line monitoring, control, and protection

Spintronics-based Reconfigurable Ising Model Architecture

Published in the International Symposium On Quality Electronic Design (ISQED), March 2020The Ising model has been explored as a framework for modeling NP-hard problems, with several diverse systems proposed to solve it. The Magnetic Tunnel Junction (MTJ)-based Magnetic RAM is capable of replacing CMOS in memory chips. In this paper, we propose the use of MTJs for representing the units of an Ising model and leveraging its intrinsic physics for finding the ground state of the system through annealing. We design the structure of a basic MTJ-based Ising cell capable of performing the functions essential to an Ising solver. A technique to use the basic Ising cell for scaling to large problems is described. We then go on to propose Ising-FPGA, a parallel and reconfigurable architecture that can be used to map a large class of NP-hard problems, and show how a standard Place and Route tool can be utilized to program the Ising-FPGA. The effects of this hardware platform on our proposed design are characterized and methods to overcome these effects are prescribed. We discuss how two representative NP-hard problems can be mapped to the Ising model. Simulation results show the effectiveness of MTJs as Ising units by producing solutions close/comparable to the optimum, and demonstrate that our design methodology holds the capability to account for the effects of the hardware.This work was supported by the National Science Foundation(NSF) under Grant 164242